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(57) Abstract: A system and a method for 
simultaneous transmission of multiple media 
streams in a fixed bandwidth networic are disclosed 
herein. The system is comprised of a central 
gateway media server and a plurality of client 
receiver units. The input media streams arrive from 
an externa] source and are then transmitted to the 
client receiver units in a compressed formaL A state 
machine on the gateway media server detects if the 
network bandwidth is close to saturation. In one 
embodiment, the potential bandwidth saturation 
is measured by matching the time when the start of 
unit of media for each stream against the estimated 
transmission time for that unit. When any one actual 
transmission time exceeds its estimated transmssion 
time by a predetermined threshold value, the 
network is deemed to be close to saturation, or 
already saturated, and the stale machine executes a 
process of selecting at least one stream as a target 
for lowering total bandwidth usage. Once the target 
stream associated with a client receiver unit is 
chosen, the amount of data transmitted by the target 
su-eam is reduced, which could result in a lower data 
transmission rate. In one embodiment, the amount 
of data is reduced by a gradual degradation of the 
precision of the data, resulting in a greater potential 
for data compression, and/or by gradually reducing 
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ADAPTIVE BANDWIDTH FOOTPRINT MATCHING FOR MULTIPLE 
COMPRESSED VIDEO STREAMS IN A FIXED BANDWIDTH NETWORK 

FIELD OF THE DISCLOSURE 

The present invention relates generally to media data transmission and more 
5 particularly to reducing bandwidth overload. 

BACKGROUND 

A number of media playback systems use continuous media streams, such as video 
image streams, to output media content However, some continuous media streams in their 
raw form oftai require high transmission rates, or bandwidth, for effective and/or timely 

10 transmission. In many cases, the cost and/or effort of providing the required transmission rate 
is prohibitive. This transmission rate problem is often solved by compression schemes that 
take advantage of the continuity in content to create highly packed data. Compression 
methods such Motion Picture Experts Group (MPEG) methods and its variants for video are 
well known in the art MPEG and similar variants use motion estimatioh of blocks of images 

15 between frames to perform this compression. With extremely high resolutions, such as the 
resolution of 1920x1 080i used in high definition television (HDTV), the data transmission 
rate of such a video image stream will be vay high even after compression. 

V 

One problem posed by such a high data transmission rate is data storage. Recording 
or saving hi^ resolution video image streams for any reasonable length of time requires 

20 considerably large amounts of storage that can be prohibitively e3q)aisive. Another problem 
presented by a high data trananission rate is that many ouQ>ut devices are incjq)able of 
handling the transmission. For example, display systems that can be used to view video 
image streams having a lower resolution may not be capable of displaying such a high 
resolution. Yet another problem is the limitations on continuous media streaming in systems 

25 wilh a fixed bandwidth or capacity. For example, in a local area network with multiple 
receivmg/output devices, such a network will often have a fixed bandwidth or capacity, and 
hence be physically and/or logistically incapable of simultaneously supporting multiple 
receiving/output devices. 
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Given the limitations, as discussed, it is ^parent that a method and/or system that 
overcome at least some of these limitations would be advantageous. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a state machine diagram illustrating an Adaptive Bandwidth Footprint 
Matching implem^tation according to at least one embodiment of the present invention; 

FIG. 2 is a system diagram illustrating a server system for implementiag Adaptive 
Bandwidlh Footprint Matching according to at least one embodiment of the present inveotion; 

FIG. 3 is a block diagram illustrating components of a gateway media server 
according to at least one embodiment of the present invention; and 

FIG. 4 is a block diagram illustrating components of a receiver client miit according 
to at least one embodiment of the present invention. 

DETAILED DESCRIPTION OF THE FIGURES 

In accordance with at least one embodiment of the present invention, a display data 
is received. It is deteracrined if a predetermined criteria is met by a first representation of the 
display data, wherein the first representation of the display data includes a first plurality of 
display streams to be transmitted to a second plurality of display devices. A first display 
stream of the first plurality of display streams is compressed in a first manner when it is 
determined that the first representation of the display does not meet the predetdmined criteria. 
An advantage of the present invention is that networks for broadcasting of media streams are 
implemented more efficiently. AnothCT advantage of the present mvention is that multiple 
media streams may be transmitted to multiple uscts on a fixed bandwidth network by 
managing degradation in transmission quality. 

FIGS. 1-4 illustrate a system and a method for transmission of multiple data streams 
in a network capable of supporting a fixed bandwidth. The system includes a central gateway 
media server and a plurality of client receiver units. The input data streams arrive from an 
external source, such as a satellite television transmission, or physical head end, and are 
transmitted to the client receiver units in a compressed format. The data streams can include 
display data, graphics data, digital data, analog data, multimedia data, and the like. An 
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Adaptive Bandwidth Footprint Matching state machine on the gateway media server detects 
if the network bandwidth is close to saturation. The start time of each unit of media for each 
stream is matched against the estimated transmission time for that unit. When any one actual 
transmission time exceeds its estimated transmission time by a predetermined threshold, the 

5 network is deemed to be close to saturation, or already saturated, and the state machine will 
execute a process of selecting at least one stream as a target for lowering total bandwidth 
' usage. Once flie target stream associated with a client receiver unit is chosen, the target 
stream is modified to transmit less data, which may result in a lower data transmission fate! 
For example, a decrease in the data to be transmitted can be accomplished by a gradual 

10 escalation of the degree of data compression performed on the target stream, thereby reducing 
the resolution of the target stream. If escalation of the degree of data compression alone does 
not adequately reduce the data to be transmitted to prevent bandwidth saturation, the 
resolution of the target stream can also be reduced. For example, if the target stream is a 
video stream, the frame size could be scaled down, reducing the amount of data per frame, 

15 and thereby reducing the data transmission rate. 

Referring now to FIG. 1, a state machine diagram of an Ad^tive Bandwidth Foo^iint 
Matching (ABFM) method with three kinds of degradation is illustrated according to at least 
one embodiment of the present invention, where degradation is used to reduce amount of data 
and^or the data rate associated with a given data stream. Although the following discussion 

20 makes use of video streams for ease of illustration, other data fonnats, such as audio, display, 
analog, digital, multimedia, and the like, may be used in accordance with various 
embodiments. In steady state 100, each video stream of a plurality of video streams is 
operating within acceptable parameters. In at least one embodiment, a video stream is 
determined to be acceptably operating when the transmission of a frame of video data is 

25 transmitted without exceeding a maximum allowed delay time. For example, digital video 
streams such as MPEG often have time stamp infomiation embedded within the stream. In 
addition to the start time TO (when the frame was successfully transmitted) of the first frame 
in a sequence of frames with a fixed interframe time, this time stamp information, including 
the known interframe time (which is fixed for a sequence of fi:ames), can be used to calculate 

30 the estimated times, of each frame as they arrive. For example, in one embodiment, the 
estimated time of frame transmission completion T'j for frame N is calculated as T'j(N) = TO 
+ N*D, where D is the interframe time. In this case, if the estimated times for transmission 
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of the start of each frame of a stream j is within acceptable limits and has not exceed a 
maximimi allowed delay Dj, stream j can be considered as operating within acceptable 
parameters. The acceptable parameters may be set by an administrator, determined 
empirically, and the like. • 

5 The desired tolerance Dj (or maximum acceptable delay time) can be calculated using 

a variety of methods. In one embodiment, the method used is to take into consideration the 
buffering size of each client receiver unit, and ensure that the client receiver unit will not run 
out of media content to decode. A typical formula to calculate Dj is to take flie size of the 
buffer and estimate a lower bound (in units of time) to consume, or fill, the buffer. As it is 

10 often desirable to keep the buffer of each client receiver unit as full as. possible, a typical Dj 
will be calculated as Dj = Tj (estimate)/!. Where Tj(estimate) is the estimated lower time 
bound to completely consume the input buffer of a receiver unit associated with stream j. 
Alternately, instead of using 1/2 of Tj(estimate), a more aggressive approach would be to use 
3/4 of Tj(estiinate), and a more conservative approach might take 1/3 of Tj(estimate). In 

15 cases where Tj (estimate) is small for receiver devices that are incapable of providing 
considerable buffer space, a conservative approach may be more appropriate. In one 
embodiment, Tj(estimate) is obtained by taking observed peak (highest) data rate (in 
bytes/second) of stream j and the smallest size of the buffers (in bytes) of all the devices 
receiving stream j. In this case, Tj(estiunate) can be evaluated as Bp/Rp, where Bp is the 

20 receive buffer size of device p and Rp is the peak data rate of stream j associated with device 
p, where device p receives stream j and has the smallest receive buffer. Alternately, Rp can 
be associated with any value between the mean (average) and the peak. In one embodiment, 
the peak data rate (Rp) can be based on the largest compressed frame. If the receiving client 
xmit does not have enough buffering capability for at least one compressed frame then it is 

25 unlikely to be able to display the video smoothly without dropping frames. 

At the commmcement of each unit of media, such as a frame of video, the ABFM 
state machine transitions to state 1 10. In state 1 10, the actual transmit time Tj (the actual time 
of frame transmission completion) is compared against the estimated transmit time T*j (the 
expected time of frame transmission completion) at the start of each frame of stream j. In one 
30 embodiment, if the actual time of frame transmission completion exceeds flie estimated time 
by less than the desired tolerance Dj (i.e. Tj - T'j < Dj), the ABFM state machine returns to 
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steady state 100. Otherwise, if ttie actual transmit time exceeds the estimated time by at least 
desired tolerance Dj (i.e. Tj -T'j >= Dj), the ABFM state machine enters state 120. 

In state 120, a victim stream v is selected &om the plurality of video streams, hi one 
embodiment, victim stream v is selected using a predetermined selection method, such as by 
5 round robin selection where each video stream is chosen in turn. In another embodiment, the 
victun stream v is selected based on a fixed priority schane where lower priority streams are 
always selected before any higher priority scheme. In yet another embodiment, the victim 
stream v is selected based on a weighted priority scheme where the stream having the greatest 
amount of data and/or the priority of each stream plays a role in its probabiUty of selection. 

10 Regardless of the method of selecting a victun stream v, in one embodiment, each 

stream j has a count, herein refened to as A(j), that refers to the current degradation value of 
the modified stream of stream j. In this case, the current degradation value of victim stream 
V, A(v), is evaluated in state 120. If A(v) is 0, in one embodiment, the one or more 
quantization fectors of the reencoding process for the victim stream v are changed in state 

15 130, Ihus resulting in a decreased in the amount of data transmitted in victim stream v.. In one 
embodiment, the quantization factors are increased resulting in a decrease in the amount of 
data transmitted in victim stireain v. For example, the MPEG algorithm uses quantization 
factors to reduce the amount of data by reducing the precision of the transmitted video stream. 
MPEG relies on quantization of matrices of picture elements (pixels) or differences in values 

20 of pixels to obtain as many zero elements as possible. The higher the quantization factors, the 
more zero elements produced. Using algorithms such as run-lengtti encoding, video streams 
(or thek associated matiices) containing more zeros can be more highly con^ressed tiian 
video streams having fewer zax>s. 

For example, the MPEG algorithm for compression of a video stream has a stage in 
25 the algorithm for a discrete cosine transform (DCT), a special type of a Fourier Transform. 
The DCT is used to transform blocks of pixels in the time domain to the fluency domain. 
As a result of this traisformation, the elements in the frequency domain, post-DCT, that are 
closest to the top left element of the resulting matrix witii indices (0,0) are weighted more 
heavily compared to elements at tiie bottom right of the matiix. If the matrix in the frequency. 
30 domain were to use less precision to represent tiie elements in the lower right half of the 
matrix of elements, the smaller values in the lower right half will get converted to zero if they 
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are below a threshold based on a quantization factor. Dividing each element by a quantization 
factor is one method utilized to produce more zero elements. MPEG and related algorithms 
often apply larger quantization values to decrease the precision of the matrices in the 
jfrequency domain, resulting in more zero elements, and hence a decrease the data 
5 transmission rate. 

After, the reducing fee data transmission of the victim stream v by modifying the 
quantization factor (state 130), ii one embodiment, the ABFM state machine transitions to 
state 160, where the degradation value A(v) is increased by one and then a modulus of 3 is 
applied, i.e. A(v)current = (A(v)previous + 1) mod 3. As a result^ the value of A(v) can cycle 
10 from 0 to 2. Since A(v) was previously determined to be 1 in state 120, the new A(v) value 
would be 1 (0+1 mod 3). After modifying the degradation value A(v) for victim stream v in 
state 160, the ABFM state machine transitions back to state 100. 

If A(v) is determined to be 1 for victim stream v in state 120, flie ABFM state machine 
enters state 140. In one embodiment, the height of the reencoded data stream is reduced by 

15 a predetermined amount, V2 for example, in state 140, resulting in a decreased amount of data 
to be transmitted. One method used to scale blocks of pixels by half is to blend and average 
pixels. Another method used is to drop every other pixel. In cases where the video stream 
is interlaced, halving the height can be achieved by dropping alternate fields, such as dropping 
all of the odd horizontal display rows or aU of the even horizontal display rows. It will be 

20 appreciated that in some formats, particularly those in the National Television System 
Committee (NTSC) and the Advanced Television System Committee (ATSQ formats, video 
streams are interlaced where the even horizoiital display ro^s for an entire fi:3me are 
displayed first and then the odd horizontal display rows are displayed next. In other 
embodiments, the height of the reencoded data stream is reduced by a factor other than a half; 

25 such as 1/3, using similar methods as appropriate. 

After the reducing the data transmission of the victim stream v by reducing the 
resolution of the stream (state 140), in one embodiment, the degradation value A(v) is 
modified in state 160, as discussed previously. The resulting value for A(v) is 2 (1+1 mod 
3). AftCT modifying tibie degradation value A(v) for victim stream v in state 160, the ABFM 
30 state machine transitions back to sta:te 100. 
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If A(v) is detemiined to be 2 for victim stream v in state 120, the ABFM state machine 
enters state 150. In one embodiment, the width of the reencoded data stream is reduced by 
a predetermined amount in state 150 using methods similar to those discussed previously with 
reference to state 140, such as dropping every other pixel. It will be ^preciated that for a 
5 same reduction factor, the reduction methods of state 140 or state 150 are interchangeable. 
In cases where the victim stream v is intorlaced, halving the height before the width is 
generally more appropriate as it is more ef&dent to completely skip alternating fields, saving 
substantial processing requirements. 

After the reducing the data transmission of the victim stream v by reducing the 
10 resolution of the stream (state 150), in one embodiment, the degradation value A(v) is 
modified in state 160, as discussed previously. The resulting value for A(v) is 0 (2+1 mod 
3). After modifying the degradation value A(v) for victim stream v in state 160, the ABFM 
state machine transitions back to state 1 00. 

In one embodiment, as a result of the cycling between 0 to 2 of the degradation value 
15 A(v) for a victim stream v, the ABFM state machine cycles through three different kinds of 
degradation of the resolution and/or the precision of victim stream v each time it is selected 
for degradation in state 120. Allhou^ an ABFM state machine utili2ang fliree kinds of data 
degradation has been discussed, in other embodiments, fewer or more steps of data 
degradation may be used according to the present invention. For example, in one 
20 embodiment, an ABFM state machine utilizes multiple step degradation involving more than 
one state of changing of quantization factors. It will also be appreciated that scaling factors 
of width and height other than 111 (e.g.: 3/4) may be used. For exan^le, in one embodiment, 
tile amomit by which the resolution and/or precision of a victim stream v is based on the 
degree to which the actual firame transmission completion time for a firame of video in victim 
25 stream v exceeds the estimated frame transmission completion time. For example, if the 
actual frame transmission completion time is 10% greater than the estimated frame 
transmission completion time, then the resolution of victim stiream- v could be scaled down 
by 10%, thareby causing the actual frame transmission completion time to likely come closer 
to the estimated fsssa& transmission completion time. 

30 Referring next to FIG. 2, Adaptive Bandwidth Footprint Matching (ABFM) server 

system 205 is illustrated according to at least one embodiment of the present invention. Data 
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streams, such as video data, display data, graphics data, MPEG data, and the like, are raput 
to gateway media server 210. In one embodiment, two main inputs sources are used by 
gateway media server 210. One input is wide area network (WAN) connection 200 to provide 
high speed Internet access. The other input is a source of media streams, such as satellite < 
5 television (using satellite dish 201) or cable television. In other embodiments, other input 
sources can be used, such as a local area network (LAN). WAN connection 200 and/or other 
.. used ii5>ut sources which can include a network comprised of cable, twisted pair wires, fiber 
optic cable, a wireless radio firequency net work, and the like. 

Gateway media server 210, in one embodiment, accepts one or more input data 

10 streams, such as digital video or display data, from satellite dish 201 and/or WAN 200. Each 
input data stream can include a plurality of multiplexed channels, such as MPEG data 
channels. Gateway media server 210 broadcasts the data streams and/or channels over a 
common medium (local data network 220) to one or more receiving cheat units, such as 
laptop 230, computer 240, or viewing unit 250. In one embodiment, there is a one-to-one 

15 correspondence between the number of data channels input to gateway media server 210 and 
the number of cfient receiver units to receive output data channels or streams. In another 
embodiment, there are fewer data channels or streams than there are receiver client units. In 
this case, two or more client receiver units may need to share one or more data channels or 
streams. Local data network 220 can include a local area network, a wide area network, a 

20 bus, a serial connection, and the like,- Local data network 220 may be constructed using cable, 
twisted pair wire, fiber optic cable, etc. During broadcast of the data streams to the receiving 
cUent units, gateway media server 210, in one embodiment, applies the ABFM algorithm, as 
discussed previously with reference to FIG. 1, to manage the network traffic to assure 
consistent and sustained delivery within acceptable parameters, thereby allowing users to 

25 view the data stream seamlessly. 

In at least one embodiment, the ABFM algorithm is utilized by gateway media server 
210 to attempt to ensure that a representation of the display data meets a predetermined 
criteria.. For example, gateway media server 210 may transmit the display data to receiver 
cUent units, where a video sequence displayed on the receiver chent units is a representation 
30 of the displayed data. If the video sequence is simultaneously displayed properly in real time 
(the predetermined criteria) on a number receiver client units, gateway media server 210 may 
not need to take further action. Else if the video sequence is choppy, is not synchronized, is 



wo 02/080518 PCT/CA02/00436 

-9- 

delayed, or is not received by all the designated receiver client units, the representation of the 
display data does not meet the predetermined criteria, and gateway media server 210, in one 
embodiment, uses the ABFM method previously discussed to modify one or more of the data 
streams of display data to improve the display of the video sequence. 

5 As discussed previously, in at least one embodiment, an ABFM algorithm is 

implemented to maintain the data Iransmission rate of ABFM server system 205 within a 
fixed bandwidth. In one embodiment, the bandwidth of ABFM saver system 205 is fixed by 
the maximum bandwidth of the transmission medium (local data network 225) between 
gateway media server 210 and the client receiver units Qaptcfp 230, conq)uter 240, or viewing 

0 unit 250), For example, if local data network is a local area network having a maximum 
transmission rate of 1 megabit per second, the bandwidth of ABFM server system 205 may 
be fixed at a maximum of 1 megabit per second. Altemately, in another embodiment, the 
bandwidth of ABFM server system 205 could be a predetermined portion of the available 
• bandwidth of the transmission medium Oocal data network 225). For exanq)le, if there are 

15 four ABFM server systems 205 connected to local data networic 225 having a maximum 
transmission rate of 1 megabit per second, each ABFM server systems 205 could be 
predeteraiined to have a fixed bandwidth of 0.25 megabits per second (one fourth of the 
, maximum available transmission rate). 

Although the transmission medium between gateway media server 210 and client 
20 receiver units is often the factor which hmits or fixes the bandwidth of ABFM server system 
205, in one embodiment, the bandwidth of ABFM server system 205 is fixed by the rate at 
which gateway media server 205 is able to input one or more data streams, compress one or 
more of the data streams, and output the compressed (and uncompressed) data streams or 
channels to the client receiver units. For example, if gateway media server 205 can only 
25 process 1 megabits of data per second, but local data network 225 has a transmission rate of 
10 megabits per second, the bandwidth of ABFM server system 205 may be limited to only 
1 megabits per second, even though local data network 225 can transmit at a higher 
iransmission rate. It wiU be appreciated that the bandwidth of ABFM server system 205 could 
be limited by other factors without departing &om the spirit or the scope of the present 
30 invention. 
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Referring to FIG. 3, gateway media server 210 is illustated in greater detail according 
to at least one embodiment of the present invention. Input media streams enter the system via 
digital tuner demnltiplexors (DEMUX) 330, from which the appropriate streams are sent to 
ABFM transcoder controller circuit 350. ABFM transcoder controller circuit 350, in one 

5 embodiment, includes one or more stream parsing processors 360' fliat perform the higher 
level tasks of digital media decoding, such as video decoding. Stream parsing processors 360 
' drive a series of media transcoding vector processors 390 that perform the low level media 
transcoding tasks. The intermediate and final results of the decoding and transcoding are 
stored in the device memory, such as dynamic random access memory (DRAM) 380. The 

10 final compressed transcoded data, in one embodiment, is transmitted according to a direct 
memory access (DMA) method via external system input/output (10) bus 320 past north 
bridge 305 into the host niemoiy (host DRAM 310). Processor 300, using a timer driven 
dispatcher, at an appropriate time, wiU route the final compressed transcoded data stored in 
host DRAM 310 to network interface controller 395, which then routes the data to local area 

15 network (LAN) 399. 

Referring next to FIG. 4, receiver chent unit 401 is illustrated according to at least one 
embodiment of the present invention: Receiver client unit 401 can include devices capable 
of receiving and/or displaying media streams, such laptop 230, computer 240, and viewing 
unit 250 (FIG. 2). The final compressed transcoded data stream as discussed with reference 

20 to FIG. 3 is transmitted to network interface controller 400 via LAN 399. The data stream is 
then sent to media decoder/renderer 420 via 10 connect 410. 10 connect 410 can include any 
10 connection method, such as a bus or a serial connection. Media decoder/renderer 420, in 
one embodiment, includes embedded DRAM 430 which can be used as an intermediate 
storage area to store the decoded data. In cases where the decoded data does not fit within 

25 embedded DRAM 430, media decoder/renderer 420 further includes DRAM 440 which is 
larger than embedded DRAM 430. As the compressed data is decoded, it is transmitted to 
receiver client 10 bus 490 and eventually is picked up by the receiver client unit's host 
processor (not shown). In one embodiment, the host processor controls video 
decoder/renderer 420 directly and actively reads the rendered data. In other embodiments, 

30 the fimctions of video decoder/renderer 420 are performed on the host via a software 
application. In cases where the host processor is incapable of such decoding tasks, video 
decoder/renderer 420 performs part of or all of the decoding tasks. 
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One implementation of the invaition is as sets of computer readable instructions 
resident in the random access memory of one or more processing systems configured 
generally as described in FIGS. 1-4. Until required by the processing system, the set of 
instructions may be stored in another computer readable memory, for example, in a hard disk 
5 drive or in a removable memory such as an optical disk for eventual use in a OD drive or 
DVD drive or a floppy disk for eventual use in a floppy disk drive. Further, the set of 
instructions can be stored in the memory of another image processing system and transmitted 
over a local area network or a wide area network, such as the Internet, where the transmitted 
signal could be a signal propagated through a medium such as an ISDN Une, or the signal may 
10 be propagated through an air medium and received by a local satellite to be transferred to the 
processing system. Such a signal may be a conq)Osite signal comprismg a carrier signal, and 
contained within the carrier signal is the desired information cantaining at least one computer 
program instmction implementing the invention, and may be downloaded as such when 
desired by the user. One skilled in the art would appreciate that the physical storage and/or 
15 transfer of the sets of instructions physically changes the medium upon which it is stored 
electrically, magnetically, or chemically so that the medium carries computer readable 
information. 

In the preceding detailed description of the figures, reference has been made to the 
accompanying drawings which form a part thereof and in which is shown by way of 

20 illustration specific preferred embodinaents in which the invention may be practiced. These 
embodiments are described in sufBcient detail to enable those skilled in the art to practice the 
invention, and it is to be understood that other embodiments maybe utilized and that logical, 
mechanical, chemical and electrical changes may be made without departing fi^om the spirit 
or scope of the invention. To avoid detail not necessary to enable those skilled in the art to 

25 practice the invention, the description may omit certain infonnation known to those skilled 
in the art. Furtheraiore, many other varied embodiments that incorporate the teachings of the 
invention may be easily constructed by those skilled in the art. Accordiuglyv the present 
invention is not intended to be limited to the specific form set forth herein, but on the 
conti^, it is intended to cover such altematives, modifications, and equivalents, as can be 

30 reasonably included within the spirit and scope of the invention. The preceding detailed 
description is, therefore, not to be taken in a limiting sense, and the scope of the present 
invention is defined only by the appended claims. 
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WHAT IS CLAIMED IS: 

1 1. A method comprising the steps of: 

2 receiving a display data; 

3 determining if a predetermined criteria is met by a first representation of the display 

4 data, wherein the first representation of the display data includes a first 

5 plurality of display streams to be transmitted to a second plurality of display 

6 , devices; 

7 compressing, in a first manner, a first display stream of the first plurality of display 

8 . streams when it is determiaed that the first representation of the display data 

9 does not meet the predetermined criteria. 

1 2. The method of claim 1, wherein the step of determining further includes proving 

2 the display streams to the second plurality of display devices using a common 

3 medimn. 

1 3 . The method of claim 2, wherein the common medium is part of a local area network. 

* 

1 4, The metiiod of claim 3, wherein a physical medium of the local area network 

2 iacludes cable. 

1 5. ' The method of claim 3, wherein a physical medium of the local area network 

2 includes twisted pair wires. 

1 6. The method of claim 3, wherein a physical medium of the local area network 

2 includes optical fiber. 

1 7. The method of claim 3, wherein the common medium includes wireless Radio 

2 Frequency. 



1 8. 



The method of claim 2, wherein the common medium is part of a wide area network. 
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9. The method of claim 1 , wherein flie predetemiined criteria is detamined to be met 
when it is expected that each display stream of the first plurality of display streams 
can be transmitted in a manna: allowing for real time simultaneous display of each 
of the first plurality of display streams. 

10. The method of claim 9, wherein the step of determining fiirtiier includes: 
determining if an actual transmission time of a firame of data for a first display 

stream of the pluraUty of display streams matches a first predicted 
transmission time. 

1 11. The method of claim 1 0, wherein the step of determining further includes: 

2 deteraiining, for each display stream in the first plurality ofdisplaystrearns, whether 

3 an actual transmission time for a video firame matches a predicted 

4 transmission time within a predetermined tolerance. 

1 12. The method of claim 9, wherein the step of deterininingfiirther includes: 

2 detennining, for each display stream in the first plurality of diq)Iay streams, whether 

3 an actual transmission time for a video firame matches a predicted 

4 transmission time. 

1 13. The method of claim 1, wherein there is a one-to-one correspondence betweai 

2 display streams in the first plurality of display streams and display devices in the 

3 second plurality of display devices. 



1 

2 
3 
4 

r 

2 
3 
4 



1 14. The method of claim 1 , wherein there are fewer display streams in flie first plurality 

2 of display streams than display devices in the second plurality of display devices, 

3 where at least one stream in the first plurality of display streams is shared by two 

4 or more display devices in the second plurality of display devices. 
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1 15. The method of claim 1, wherein flie step of receiving further includes the display 

2 databeing video data. 

1 16. The method of claim 1, wherein the step of receiving fiirther includes the display 

2 data being gr^hics data. 

4 

1 17. The method of claim 1 , wherein the step of receiving further includes the display 

2 data being digital data. 

1 18. The method of claim 1, wherein the step of receiving fiirther includes the display 

2 data being analog data. 

1 19. The method of claim 1, wherein the display data further includes display data ftom 

2 a plurality of sources. 

1 20. The method of claim 1, wherein the step of receiving further includes receivmg at 

2 least a portion of the display data jfrom a digital data stream havmg a plurality of 

3 multiplexed channels. 

1 21. The method of claim 20, wherem the digital data stream having a plurality of 

2 multiplexed channels is an MPEG data stream. 

1 22. The method of claim 1, wherein tiie step of determining includes: 

2 determining if the predeteraiined criteria is met when the first plurality of display 

3 streams is to be transmitted to the second plurality of display devices using 
' 4 a fixed bandwidth. 



1 23. 
2 



The method of claim 22, wherehi the fixed bandwidth is the maximum bandwidth 
of the transmission medium. 
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24. The method of claim 22, wherein the fixed bandwidfli is a predeteraiined portion of 
the available bandwidth of the transmission medium. 

25. The method of claim 22, wherein the fixed bandwidth is the maximmn bandwidth 
of a processing device that performs the step of compressing medium. 

26. The method of claim 1 fiirther comprising the step of: 

selectmg the first display steam from the first plurality of display streams usmg a 
predefined selection method. 

27. The method of claim 26, wherein the predefined selection method includes using a 
round robin method. 

28. The method of claim 26, wherein the predefined selection method hicludes selecting 
a display stream of the plurahty of display streams having a greatest amount of data. 

29. The method of claim 26, wherein the st&p of selecting is based on a prioritization 
of one or more of the display streams associated with the plurahty of display 
streams. 

30. The method of claim 26, wherein the step of selecting the first display stream is 
based upon a previous compression of a display stream m the first plurahty of 
display streams. 

31. Themethod of claim 1, wherem the step of compressing includes: 
compressing in the first manner when it is determined the first display stream is has 

not been previously compressed; 
compressing in a second manner when it is determined that the first display stream 
' has been previously compressed in the first manner. 
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1 32. The method of claim 3 1 , wha-ein the step of compressing further includes: 

2 compressmg in a third maimer when it is determined that the first display stream has 

3 been previously compressed in the second manner. 

1 33. A method comprising the steps of: 

2 i determining, for each display stream of a plurality of display streams, if an 

3 estimated transmit time meets an actual transmit time within a desired 

4 tolerance, if not, there is too much data being transmitted; 

5 selecting a first stream of the plurality of display streams based on a prioritization 

6 method; 

7 selecting one of a plurality of compression methods to be applied to the first stream; 

8 repeating each of the above steps until the step of determining indicates the actual 

9 transmit time is within the desired tolerance of the estimated transmit time. 

1 34. The method of clahn 33, wherein the desired tolerance is based on a desired 

2 iransmissionratetoproviderealtimesimultaneousdisplay of each of the plurality 

3 of display streams. 

1 35, The method of claim 33, wherein one of the plurality of compression methods 

2 includes reducing the precision of the first display stream. 

1 36. The method of claim 33, wherein one of the plurality of compression methods 

2 includes reducing the resolution of the first display stream. 

1 37. A method comprisuig the steps of: 

2 receiving a multimedia data stream having a plurahty of multimedia channels; 

3 determining, for each multimedia chaimel in the multimedia data stream, whether 

4 an actual transmission time for a multimedia channel matches a predicted 

5 transmission tkne within a predetermined tolerance; 

6 selecting, using a predefined selection method, a first multimedia channel; 
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reducing an amount of data to be transmitted associated with the first multimedia 
chamiel when it is determined actual transmission time of the first 
multimedia chamiel exceeds the predicted transmission time by an amount 
greater than the predetemiined tolerance. 

38. The method as in claim 37, wherein the predefined selection metiiod includes a 
round robin method. 

39. The method as in claim 37, wherein the step of reducing includes reduciag the 
precision of the data transmitted by the first multimedia channel. 

40. ■ The method as in claim 37, wherein the step of reducing includes reducing the 

resolution of the data transmitted by the first multimedia channel. 

41. The method as in claim 37, wherein the multimedia data stream includes MPEG 
data. 

42. A system comprising: 
a data processor; 

memory operably coupled to said processor; and 

a program of instractions capable of being stored in said memory and executed by 
said processor, said program of instruction to manipulate said processor to: 
receive a display data; 

determine if a predetermined criteria is met by a first representation of the 
display data, wherein the first representation of the display data 
includes a first plurality of display streams to be transmitted to a 
second plurality of display devices; 

compress, in a first manner, a first display stream of the first plurality of 
display streams when it is determined that the fiarst representation of 
the display data does not meet tiie predetemiined criteria. 



1 
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1 43. A computer readable medium tangibly embodying a program of instructions to 

2 manipulate a data processor to: 

3 receive a display data; 

4 determine if a predetermined criteria is met by a first representation of the display 

5 data, wherein the first representation of the display data includes a first 

6 plurality of display streams to be transmitted to a second plurality of display 

7 devices; 

8 compress, in a first manner, a first display stream of the fiarst plurality of display 

9 streams when it is determined that the first representation of the display data 
10 does not meet the predetermined criteria. 
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Receiver Client System Block Diagram 
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(57) Abstract: A sy.<icm and a mclhod for 
simuliuncous ininsmission of multiple media 
.*:(reani.< in a tixed hamlvvidlh ni:t\vori; are disclosed 
herein. 'Ilic .Kysicm is comprised of a ccntrdl 
gateway media sender am) a plunility of client 
receiver units. 'ITic input media struams arrive 
from an external .<coua'e ami are then iransmilled lo 
the client receiver units in a comrvesseil lumiai. A 
state machine un ihc j:;ttc\s:5y mcilij scrx jr lIoiclIn 
if the netwiifk h:indv\idih is close u» sjiuraliiiu. 
In one embodin^cnl. ihc i^tienlial hamtwidlh 
s;iluraiion is measured by nutichiiii: the lime when 
ihc slari ol* unit uj' nwdb lot o:ich slre:im ;ii:;iinsi 
ihc estimated Iransmission linic lor lh:ii unii. 
When any one actual tninsmlssion lime exceeds 
lis estimated iransmssion lime by a prcilcierrnincd 
ihreshoUl value, ihe network is deemed in bcclnse 
lo saturation, or already saturated, and the state 
machine executes a pr4>cess of selecting al least 
one stream as a larcet lor lowerine tnial bandwidih 
usat;e. Once ihe target stream associated uiih a 
client receiver unit is chosen, ihe anuiunl tit' data 
transmitted by the tartei stream is reiluceil. which 
could result. in :i tower data transmission rale. In 
one embodiment, the amount of data is reduced 
by a jsnidual dcLTaifaiicM) of the precision ol' 
the data, resuliinu in a t:reater potential lor data 
amipression. and/or by gradually reducing the 
resolution of the data ol" the iamet stream. 
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